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Here  are  some  of  the  technical  leads  we  have  been  following  during  this  quarter: 

•  We  completely  revamped  our  approach  to  concurrency  in  plans.  In  our  transformational  planner, 
plans  are  just  programs,  which  request  resources  in  competition  with  other  plans,  and  suspend  when 
the  resources  are  in  use.  However,  the  system  of  semaphores,  called  “valves,”  used  to  control  access  to 
resources  is  somewhat  more  complex  than  in  standard  programming  systems,  because  of  our  attempt 
to  couple  the  semantics  of  the  valve  system  to  the  semantics  of  the  task  hierarchy.  If  one  process  Pi  is 
associated  with  a  subtask  of  another  process  P i  —  that  is,  if  Pi  is  a  subprocess  of  P2  —  then  Pi  has 
the  right  to  pre-empt  a  valve  from  P2,  causing  P2  to  suspend.  The  rationale  for  this  behavior  is  that 
plan  Pi  is  presumably  part  of  plan  P2,  so  that  Pi's  goals  will  be  advanced  with  minimal  interference  by 
allowing  Pi  to  proceed.  (Example:  Pi  might  be  the  plan  to  carry  something  to  a  destination,  and  Pi 
might  be  the  plan  to  open  a  door  along  the  way;  if  the  two  compete  for  a  hand,  then  Pi  should  win; 
once  the  door  is  opened,  Pi  can  proceed.) 

However,  there  is  another  level  of  complexity.  In  our  plan  language,  a  plan  Pi  may  be  a  policy  on 
another  plan  Pi-  (This  is  indicated  with  the  construct  (WITH-P0LICY  Pi  P2).)  The  intent  is  that  Pi 
be  executed  with  Pi  serving  as  a  constraint.  An  example  might  be  to  carry  an  object  with  the  policy  of 
picking  it  up  should  it  be  dropped  or  put  down.  Policies  clearly  should  take  priority  over  the  tasks  they 
constrain.  The  way  we  implement  this  behavior  is  to  introduce  a  distinction  between  a  process  being 
wait-blocked  and  a  process  being  valve-blocked.  A  process  is  wait-blocked  if  all  of  its  threads  are  queued 
on  “fluents,”  that  is,  registers  standing  for  conditions  that  may  eventually  become  true.  The  process 
that  picks  up  an  object  when  it  is  dropped  is  normally  wait-blocked,  because  most  of  the  time  its  only 
thread  is  queued  on  a  fluent  connected  to  the  force  sensor  for  the  hand  carrying  the  object.  If  that  force 
sensor  should  register  zero,  the  thread  will  resume.  A  process  P  is  valve-blocked  if  there  is  some  valve 
V  requested  by  a  superprocess  of  P  such  that  P  is  neither  a  subprocess  nor  a  policy  on  the  owner  of  V . 

The  way  we  implement  the  policy-priority  scheme  is  this:  every  time  (WITH-P0LICY  Ai  Ai)  is 
executed,  two  new  processes  are  generated,  and  a  hidden  valve  Vp  is  created  that  they  contend  for.  The 
plan  interpreter  makes  sure  the  following  invariant  is  satisfied:  The  process  for  Ai  owns  Vp  if  and  only 
if  the  process  is  not  wait-blocked.  This  rule  ensures  that  the  process  for  Ai  is  valve-blocked  whenever 
the  process  for  Ai  is  not  asleep  waiting  for  some  event. 

This  scheme  is  much  cleaner  than  our  previous  scheme,  and  eliminates  some  flakey  behavior  that 
plagued  earlier  implementations.  We  will  be  writing  more  complete  documention  on  it  soon. 

•  We  have  developed  a  new  method  for  incorporating  task  information  in  sensor  data  fusion  algo¬ 
rithms  that  drastically  reduces  the  amount  of  computation  needed  to  process  information.  This  result 
is  specifically  oriented  toward  reaching  propositional  decisions  such  as  a  planner  would  make  during  the 
course  of  its  operations.  As  a  consequence,  we  are  one  step  closer  to  integrating  sensing  and  planning 
together  in  a  general,  adaptible  fashion. 

•  We  have  extended  our  image-tracking  algorithms  to  track  image  patches  under  nearly  all  projective 
transformations.  That  is,  it  is  now  possible  to  select  a  target  region  of  the  image,  and  to  track  it  as  it 
translates,  rotates,  and  scales.  These  transformations  encompass  the  type  of  image  deformations  that 
a  mobile  robot  would  encounter  while  homing  or  navigating  relative  to  a  chosen  landmark.  Hence, 
it  should  be  possible  to  use  this  algorithm  to  implement  some  of  the  behaviors  used  by  our  mapping 
algorithm. 
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Activities: 

Drew  McDermott,  March  3:  Talk  at  Carnegie-Mellon  on  “Transformational  Planning  of  Reactive 
Behavior.” 

Greg  Hager,  March,  “A  Constraint- Pas^d  View  of  Selective  Perception”,  presented  at  the  AAAI 
Spring  Symposium  on  Selective  Perception,  Stanford,  CA. 
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Drew  McDermott,  March  25-27:  Presented  talk  “Perceptual  Confusion  in  Reactive  Plans,”  at  AAAI 
Spring  Symposium  on  Computational  Considerations  in  Incremental  Modification  and  Reuse. 

Greg  Hager,  April,  “Sensor  Data  Fusion,”  a  lecture  delivered  at  Red  Stone  Arsenal,  Huntsville, 
Alabama. 

Drew  McDermott,  April  15:  Talk  at  University  of  Chicago  on  “Building  and  Fixing  Diktiometric 
Maps  for  Robot  Navigation.” 

Drew  McDermott,  April  16:  Talk  at  Northwestern  University,  “Transformational  Planning  of  Reac¬ 
tive  Behavior.” 

Sean  Engelson,  May,  “Error  Correction  in  Mobile  Robot  Map  Learning,”  presentation  at  the  IEEE 
International  Conference  on  Robotics  and  Automation,  Nice,  France. 

Greg  Hager,  May,  “Constraint  Solving  Methods  and  Sensor-Based  Decision  Making,”  presentation 
at  the  IEEE  International  Conference  on  Robotics  and  Automation,  Nice,  France. 

Greg  Hager,  June,  “Sensor-Based  Decision  Making”  presented  at  the  DLR  (German  Space  Organi¬ 
zation),  Oberpfaffenhofen,  Germany. 

Publications: 

Sean  Engelson  and  Drew  McDermott,  Error  correction  in  mobile  robot  map  learning.  Proc.  IEEE 
Conf.  on  Robotics  and  Automation ,  pp.  2555-2560 

Greg  Hager,  “A  Constraint-Based  View  of  Selective  Perception”,  Proceedings  of  the  AAAI  Spring 
Symposium  on  Selective  Perception,  Stanford,  CA,  March  1992. 

Greg  Hager,  “Constraint  Solving  Methods  and  Sensor-Based  Decision  Making”  Proc.  IEEE  Conf. 
on  Robotics  and  Automation, 

Drew  McDermott,  “Perceptual  Confusion  in  Reactive  Plans,”  Proc.  of  the  AAAI  Spring  Symposium. 
Personnel  Support: 

We  supported  one  graduate  student,  Michael  Beetz,  half-time  during  this  period.  In  addition,  we 
employed  a  part-time  programmer,  Amy  Wang,  and  a  secretary,  Paula  Murano. 

Expenditures: 

The  accompanying  table  shows  the  figures  for  expenditures  to  date,  including  amounts  committed 
but  not  actually  spent. 

Overall  Status  and  Plans: 

We  are  happy  with  our  progress  so  far.  Over  the  summer,  we  plan  to  focus  on  making  the  plan¬ 
ner/executor  more  robust.  In  particular,  now  that  the  valve  handler  has  been  rewritten,  we  can  rewrite 
strategies  for  breaking  deadlocks  on  valves. 
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